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Abstract 

Creation o. an interactive display envi runner, t can expose ’ tn^short^riod 

parent from nongraphics development approaches. arqe am . resourC es. In addition, changes in the eco- 

nomirT^of computing havelnabled'broader graphics usage beyond traditional engmeenng and design into integrated 
telerobotics and Artificial Intelligence (A!) applications. 

the highly integrated nature of space operations often tend to P l ann i ng" a nd S Ana 1 t v i "Ton 

commumcat ion to ensure success. Graphics simu a d wide variety of graphical analysis 

( IIP A 0 ) of NASA’s Johnson Space Center are focusing on the evaluation of a wide variety or g ao 

within the context of present and future space operations. 

r „, Dur - ...n x. . f xu. several telerobotics and At applications studies utilizing graphical illation. . 

I* mm**** •< <■«•«;' <"»> tm,~. 


r:PAD Technology Overview 

. „ "V ,->nAh,'i'!PS reouims the identification of ennancinq and enabling 

ef fi c ,ont S and a co St-effective r tmp! eirwrhiat ion. Camples of the integrated nature of operations across levels 

i nr 1 nrlo : X. 


ncludo: v 

: Allocation of comniand and control authority between ground- 

2) Dete-m. nation of degree of automation: ho^ ground and onboard for various systems; 

,q U , red r 0 aulWe functions: speed, parallel, realtime, expert systems. 

\ 

emKijtat ion approaches dictates an integrated software 

of technology ipoli- 


3) Determination of capabilitie 
etc 


the wide range of possible configurations and inplwfcqt.it. ion approaches dictates an , 
iy stems strategy. Such ? a strategy is\ey to successful process through the many s.ages • 

;a t i ona i roddine^s. \ 5 

At MPAO, activities are supported by m-place laboratories and test beds 'or ' 

graphics research, robotics software systems, rendezvous, proxops soKwa-e. and vi.ion syste • 

The expert systems technologies testbed -s an extensive A! lab w.’h p roven e, n _J«tve 

ssss&as: snsss^r * 

dezvous/ proxops Software testbed supports investigations of automated dtzv u. ^ ^ . , , . v „„. . I( , , rPd Jt,me 
closed loop guidance, targeting, and control via an automated *-.qu _ ' * . - u t s /s'en -ode's the 

Simulation capabilities with G degree of freedom equations < f mo.on and h gh de, Current 

vision systems software simulation lab consists of hardware and software .fa’ 1 1 , t ,es a. .. . 
and pending research includes low and intermediate level vision sidles. 


Graphics Research Laboratory 

The graphics research laboratory provides capabilities for simulation and animation of space vehicles and 
robotics operations. The conf iguration of the graphics laboratory is illustrated in figure 1. The laboratory 
evaluates a wide variety of state-of-the-art graphics hardware and software. General applications include: 

Crew Training; 

Development of intelligent graphics software supporting system interconnection and user friendly, 
menu d'iven interfaces; 

Modeling of diverse and complicated vehicles; 

Expert systems/graphics lab interfaces and applications for development of advanced information 
commumcat ions ; 

Applications for robotic manipulators; 

Development of high fidelity graphics systems to augment and/or replace operator 1 i ne-of-si ght 
television requirements; 

Graphics hardware and software s ta te-of - the-art enhancements; 

- Mission simulations and demonstrations for satellite rendezvous, close-in separation and contact, 
cargo transfer, manipulator operations, coordinated robotics activity, and communications. 

- Analytical support to Mission Design and Development, and Guidance and Navigation branches at 
Johnson . 

The following sections of this paper will now describe three integrated applications utilizing graphical 
simulation which illustrates some of MPAD's capabilities. 


Coordinated MMtl and RMS Operations 

Two training simulators used in tandem to rehearse joint mission activities require communication or "talk" 
between one another. Presently in the MPAD graphics lab, an operator of a remote manipulator arm (RMS) s.mulator 
can observe on a television screen the flight of a manned maneuvering unit (MMU) being simulated across the room. 

The MMU (a backpack worn by an astronaut to maneuver outside thp space shuttle) is seen to move around the 
remote manipulator arm screen as it flies around in the field of view. Thus, astronauts on the space station, 
for example, who are assigned a new task of repairing a satellite using both the RMS (used to grapple payloads 
or serve as an astronaut platform) and the MMU backpack, could rehearse the mission together in a coordinated 
manner . 

A prototype of this simulator project was completed in 1986 and integrated into the existing graphics 
laboratory facility. Upcoming plans call for a system designed for a unique application to be built around 
the prototype design. Its applications are not limited to the space station and has the potential for a wide 
range of uses. 


helmet Mounted Di xj) lay System 

MPAD is developing a low cost 3-dimensional helmet simulator for a variety of applications, particularly 
soace station and rehearsal of satellite rescue and repair missions. The system, shown in figure 2 presents 
a line segment picture to a pilot or astronaut wearing the unit that changes with head movement. The helmet 
mounted display system provides new and improved ways of looking at 3-dimensional data as applied to flight 
simulation and other applications. Compared to non-movable graphics displays the helmet mounted display offers 
several advantages, most important of which being the ability to surround the viewer with an artificially gen- 
erated geometric scenario that is truly 3-dimensional and stereograph! c . 

Transformation and associated graphics subsystems were developed in the MPAD graphics lab and are connected 
'.o the system. joysticks and helmet positioning devices form the interactive input to the system. .he numerical 
hardware processes the input and computes the visual scene. Feedback is passed on to the output hardware which 
consists of a pair of miniature video monitors mounted directly on the helmet. 

The fixed displays wilt soon be replaced by stereo displays, with a resultant increase in visual realism. 
Efforts are underway to replace the stick figures by developing specialized computer hardware to generate real- 
time shaded images. Later, artificial image generation will Pe combined with real-world video to further en- 
hance the system. 

There is a wide range of applications that could benefit from replacing stationary displays with helmet 
mounted displays. Telepresence servicing and flight simulation are only a few examples where the visual feed- 
back can be enhanced by an order of magnitude. For instance consider simulating operations from within .he 
space station cupola structure. Instead of building a physically large '-’.me with five full size monitors. 
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the helmet mounted display system would provide better realisim with just two " on ' *° r >. d ([jon'^here 

Generation hardware would now only have to compute two images in realtime instead of five. In addition, there 
would be no need for physical construction of the cupola structure since it could be simulated in software to- 
oether with the rest of the space station. Replacing table-top windows into the simulated scene by a stereo 
Sir of li!ing windows can Jeffect project the operator into the artificially generated geome r,c scenario 
in every sense of the word, opening a new dimension in simulation realism and analysis capaoil i ties. 

Automa ted R endezv ous Expert System 

The Rendezvous Expert (RENEX) system was developed to demonstrate the concept of using an expert I system to 
oerform autonomous rendezvous and proximity operations onboard a space vehicle during flight. The effort was 
motivated by the need to streamline operations for the space shuttle and space station programs as well as to 
£?ovide insight Into the mission requirements for greater autonomy during rendezvous operations in Earth orbit 
and liars Sample Return and Comet Nucleus Sample Return unmanned missions. 

The svstem consists of three basic components: 1) an expert system which controls the overall system by 

sending trajectory sequencing commands to and receiving feedback data from 2) a software simulation^ space 
vehicles in orbit which calculates realtime trajectory data and sends trajectory information .0 3) a graphics 

system for display. 

One of the project goals was to develop technology which was transferable to various types of trajectory 
control software U' Support future NASA projects, i.e.. ground premiss. on planning, ground real t .me p anning 
and monitoring, and onboard planning and monitoring. The technology can be incorporateo into ground software to 
aid ground flight planners and controllers, or into onboard software to aid crewpersons and P^de greater 
manned vehic 1 e autonomy . It can also be integrated into appropriate planning and monitoring functions 
board software to provide automatic operations for either manned or unmanned vehicles. 

An example of a technology integration spinoff is depicted in the augmented RENEX system conf iguration 
shown in figure 3. A voice interface was connected which allowed voice commands to be used to ov erridethe 
automatic trajectory planntnq capability. Another potential spinoff involves demonstrating an automated capa- 
bly to monitor° the trajectories of spacecraft detached from the space station. Such a system could simulate 
man- in- the- 1 oop telerobotic control of, for instance, an orbital maneuvering vehicle (°MV) being flown to a 
space station berthing area. A modified RENEX system could monitor the trajectory and system health conditions 
and update station crew operator(s) on trajectory and safety conditions. Among the achievable benefits of auto- 
mating and assisting monitoring tasks would be reductions in crew workloads. 


Summary 

Identifying enhancing and enabling technologies for automated space operations necessitates the focusing 
of technology and advanced development activities. Plans implemented in e vo 1 ut 1 °nary , Du 1 Id 1 nq-blou < approve 
must encompass research, simulations, advanced development, and demonstrations. Critical to success s 
gration. Utilization of a broad range of graphics tools provides for: 

- identification of hardware and software enabling and enhancing technology requirements, 

- evaluation of hardware/sof tware designs, 

- identification of effective command and control approaches, 

- performance of hardware and software tradeoffs between alternative operational conf i rgurations. 

Graphics capabilities, together with artificial intelligence and simulation tools, provide a technology 
base upon which to assess incremental progress in achieving autonomy objectives and for estimating the incre- 
mental cost of greater autonomous capabilities for space systems. One of the most important advan ages 1 
that it allows us to progress from fully man controlled operations to the appropriate degree of autonomy in 
an evolutionary, planned, controlled, and well understood progression. 
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Figure 2 


Helmet-Mounted Display System 


A - LEFT DISPLAY 
B - RIGHT DISPLAY 
C - 3-D LOCATOR TRANSMITTER 
D - 3-D LOCATOR RECEIVER 
E - LEFT IMAGE GENERATOR 
F - RIGHT IMAGE GENERATOR 
G - INPUT DEVICE 
H - SYSTEM CONTROLLER 
I - DISPLAY CONTROLLER 
J - VECTOR RASTERIZER 
K - GEOMETRY ENGINE 
L - ENVIRONMENT DATABASE 



Figure 3 


RENEX System Configuration With Voice Interface 
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